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Abstract 

Tsallis' non-extensive entropy S q enables us to treat both a power and exponential 
evolutions of underlying microscopic dynamics on equal footing by adjusting the 
variable entropic index q to proper one q*. We propose an alternative constraint of 
obtaining the proper entropic index q* that the non-additive conditional entropy 
becomes additive if and only if q = q* in spite of that the associated system cannot 
be decomposed into statistically independent subsystems. Long-range (time) cor- 
relation expressed by (/-exponential function is discussed based on the nature that 
(/-exponential function cannot be factorized into independent factors when q ^ 1. 
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1 Introduction 



There has been growing interest in the non-extensive statistical mechanics 
[1,2] based on Tsallis' generalized entropy (in fcg = 1 unit): 



s 9 = - E f . (5> = i; gen) 
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At least formally, Tsallis' entropy is an extension of conventional Boltzmann- 

Shannon (BS) entropy with one-real-parameter of q. In the limit of q — > 1, 

Tsallis' entropy Eq. (1) reduces to BS entropy, Si = — J2iPi In Pi, since p\~ x = 
e (g-i)in Pi w x + ( g _ i)i np .. 

The parameter g may be interpreted as a quantity characterizing the degree 
of non-extensivity of Tsallis' entropy through the so-called pseudo-additivity: 

S q (A, B) = S q (A) + S q (B) + (1 - q)S q (A)S q (B), (2) 



where A and B denote two statistically independent sub-systems. It is worth 
while to realize that the pseudo-additivity of S q is one of the crucial ingredi- 
ents of Tsallis' non-extensive statistical mechanics. In fact, the uniqueness of 
Tsallis' entropic form is proved [4] for an entropy that fulfills the generalization 
of the Shannon-Kinchin axioms [5] based on the pseudo-additive conditional 
entropy obeying the pseudo-additivity instead of additivity. Then what is a 
role of the pseudo-additivity? By rewriting Eq. (1) as the following form, 

S q = -J^Pi^qPi, (3) 



we see that the pseudo-additivity of Tsallis' entropy comes from the g-logarithmic 
function, which is defined by 

M*) = - T ^-, (4) 



since it equips the pseudo-additivity as 

ln q (xy) = ln q x + ln q y + (1 - q) ln g x ln g y. (5) 



The inverse function of the g-logarithmic function is g-exponential one, which 
is defined by 

exp,(a;) = [l + (l-g)a;]^i, (6) 



for 1 + (1 — q)x > and otherwise exp q (x) = 0. 

As Tsallis [3] has already pointed out, the parameter q plays a similar role 
as the light velocity c in special relativity or Planck's constant h in quantum 
mechanics in the sense of a one-parameter extension of classical mechanics. 
Unlike c or h, however, q does not seem to be a universal constant. Thus it 
is a natural question whether q is merely an adjustable parameter or not in 
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the non-extensive statistical mechanics. In some cases the parameter q has 
no physical meaning, but when it is used as an adjustable parameter the 
resulting distributions give excellent agreement with experimental data. In 
other but a few cases [6-10], q is uniquely determined by the constraints of 
the problem and thereby q may have a physical meaning. Recent studies of 
the characterization of mixing in one-dimensional (ID) dissipative maps [6-8] 
and of symbolic sequences [9] seems to provide a positive answer to the above 
question since there exists the special value q* such that S g * becomes linear. 
For example, in the studies [6,7] of mixing in simple logistic map, q* can be 
obtained by three different methods based on: i) the upper bound of a power- 
law sensitivity £ to initial conditions; ii) the singularity indices in multi-fractal 
structure; and iii) the rate of information loss in terms of S q . The remarkable 
fact is that all methods lead to the same value of q* ~ 0.24, which may shed 
some light on the physical meaning of q. They established some connections 
among the sensitivity £ to initial conditions, Tsallis' entropy S q and the proper 
entropic index q*. In particular we focus on the work of Buiatti et al. [9], in 
which they have shown, for the symbolic sequences with length of N, that the 
generalized block entropy [11] is proportional to N when the proper entropic 
index q* is used. In other words, there may exist a proper entropic index q* , 
which may statistically characterize a non-extensive system. 

In this work we study a reason why the generalized block entropy in the work 
of Buiatti et al. [9] is proportional to the length N of symbolic sequences when 
we use the proper entropic index q*. In particular we focus our attention on 
a role of the pseudo-additivity of the conditional entropy in characterizing a 
non-extensive system with the proper entropic index q*. We reformulate the 
constraint of obtaining the proper entropic index q* as follows: the pseudo- 
additive conditional entropy becomes additive with respect to iV when the 
proper entropic index q* is used. In other words, for the special value q* of 
entropic index, the additivity of the conditional entropy is held in spite of that 
the involved subsystems are not statistically independent of each other. 

The rest of the paper is organized as follows: in the next section we explain the 
constraint of obtaining the proper entropic index q* in the work [9] of Buiatti 
et al, and propose our constraint of obtaining q*. We then show the equiva- 
lence of the two constraints and discuss the underlying simple mechanism of 
why the conditional entropy becomes additive for the proper entropic index q* 
under the assumption of equi-probability. In Section 3, we discuss long-range 
correlation expressed by g-exponential function. Section 4 is devoted to our 
conclusions. 
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2 How to determine a proper entropic index 



Buiatti et al. [9] showed, by studying a symbolic binary sequence {<Ti, cr 2 , • • •} 
with a long-range correlation, that for the probability p(ui, • • ■ , cr N ) of each 
path with length of N, the generalized block entropy [1 1] , 

S q (N) ee 1 -^^->^ | (7) 



is proportional to TV if and only if the variable index q equals the proper 
entropic index q*. 

We reformulate this constraint as the following. The pseudo-additive condi- 
tional entropy [12], which is defined by 

Sqim= i + (i-<zWi) ' ( ) 



should satisfy the additivity, 

S q (N\l) = S q (N-l\l) + S q (l\l), (9) 



when g is equal to the proper entropic index q*. At first sight our constraint 
seems to be paradoxical, since S q is pseudo-additive in general. We explain in 
the followings that the equivalence of the two constraints which determine q*, 
and discuss an underlying simple mechanism connecting the variable entropic 
index q with the proper index q*. 



2. 1 Proof of the equivalence of the two constraints 

The method of Buiatti et al. is rephrased as follows: S q (N) is a linear function 
of TV when q = q*, i.e. 

S q .(N) = (N-l)Lg.+S q .(l), (10) 

where L q * is a proportional constant, or equivalently 

S q .(N + 1) - S q *(N) = S q *(2) - = L,., for N > 1. (11) 



4 



Subtracting ^(l) from the both sides and after a little bit algebra, Eq. (11) 
is rewritten as 

S q *(N + 1) - = S q *(N) - + S q *(2) - (12) 



Dividing the both sides of Eq. (12) by 1 + (1— q*)S q *(l) and using the definition 
of the conditional entropy of Eq. (8), it is obvious that Eq. (11) is equivalent to 
Eq. (9). Hence we have reformulated the method of Buiatti et al. as follows: 
the conditional entropy becomes additive when we use the proper entropic 
index q*. 



2.2 A reason why S q *(N\l) is proportional to N 



Having explained the equivalence of Buiatti et al. and our methods of obtain- 
ing a proper entropic index q*, we now consider why the conditional entropy 
S^iVll) is proportional to the length N of symbolic sequences when q = q*. 

Under the assumption of equi-probability, Tsallis' entropy can be written in 
terms of the number of states W(N) for the symbolic sequences with the 
length of iV as 

S q (N)=\n q W(N). (13) 



Then the conditional entropy of Eq. (8) is expressed in terms of W(N) as 
g g (ATll)=m g ^ + 1) . (14) 



Suppose that the number of states W(N) obeys a power-law evolution, which 
can be well described by 

W(N + 1) = W(l) exp ,(L'» N), (15) 



with the proper q* of a system of interest, where L' q * is another constant. 
The relation between L' q , and L q * of Eq. (11) is discussed in the next section. 
Substituting Eq. (15) into Eq. (14), the corresponding conditional entropy can 
be written as 

S q (N\l) = l < W w(l) 1) ] = Wexp^* N)}. (16) 
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Now we readily see that S q (N\l) is proportional to N, if and only if we set g to 
q*. In other words, if W obeys the g*-exponential evolution of Eq. (15), then 
it is reasonable to use its inverse function in order to define the conditional 
entropy. 



3 Long-range correlation expressed by g-exponential function 



Tsallis' entropic description may be well suited for a long-range correlated sys- 
tem which obeys a power-law evolution described by g-exponential function. 
Then how can g-exponential function express long-range correlation? We here 
explain that long-range correlation may be expressed by the non-factorizability 
of g-exponential function into independent terms. The long-range correlation 
in this case means the initial condition dependency of long duration. It is 
known that g-exponential function cannot be resolved into a product of inde- 
pendent terms unless g = 1. For example exp g (t + s) is not resolved into the 
independent factors as exp q (x) ■ exp g (s). Instead it can be expressed as the 
product of the dependent factors as expire) • exp g (s/{l + (1 — q)x}). 

Let us focus on the long-range correlation associated with the power-law 
evolution of W(N) described by Eq. (15). Using Eqs. (10) and (13), the q- 
exponential dependency of W(N + 1) can be expressed as 



W(N + 1) = exp q [S q (N + 1)] = expj^(l) + L q N] 
= exp^(l)].expj 1+ L ^ ] 



= expj^(l)].expj i + (i _^ (i 

h 

l l + (l-g){^(l) + iV-l} 



Note that ^(l) appears in all terms and this reflects the initial condition de- 
pendency of long duration. This feature is consistent with the single-trajectory 
approach by Montangero et al. [15] in which they fix a given initial condition 
in order to obtain the q* of the non-extensive version of Kolmogorov-Sinai 
entropy for the dynamics of the logistic map at the chaotic threshold. Because 
of the initial condition dependency of long duration, an averaging over many 
different initial conditions is not appropriate. 

Now let us focus on the relation between the proportional constants L' q * and 
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Lq* in the previous section. From the second line of Eq. (17), we see that 

L„N 



W(N + 1) = W(l) -exp [ 



l + (l-g)^(l) J - 



Comparing this with Eq. (15), L' q * and L q * are related by 
L q * = L q » 



which is the same relation [14] of A' = \/Z q ~ q between the Lagrange multi- 
plier A' of optimal Lagrange multipliers (OLM) method and that A of Tsallis- 
Mendes-Plastino one in canonical ensemble formalism, where Z q denotes par- 
tition function. 



4 Conclusions 



We have proposed a constraint of obtaining the proper Tsallis' entropic index 
q* in describing the evolutions of correlated symbolic sequences with length 
N . The proper entropic index q* can be determined by requiring that the 
conditional entropy S , e (A^| 1) should be proportional to N if and only if q equals 
the proper entropic index q*. In other words S q becomes additive for the proper 
q* . It is the non-factorizability of g-exponential function into independent 
terms that can express a long-range correlation. 
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